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Abstract 

In this paper, we investigate global convergence properties of the inexact nonsmooth Newton 
method for solving the system of absolute value equations (AVE). Global Q-Hnear convergence 
is established under suitable assumptions. Moreover, we present some numerical experiments 
designed to investigate the practical viability of the proposed scheme. 
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1 Introduction 

Recently, the problem of finding a solution of the system of absolute value equations (AVE) 

Ax — |x| = b, (1) 

where A G and b € M” = has been received much attention from optimization commu¬ 

nity. It is currently an active research topic, due to its broad application to many subjects. For 
instance, linear complementarity problem, linear programming or convex quadratic programming 
can be equivalently reformulated in the form of ([1]) and thus solved as absolute value equations; 
see [SKSlElKin]. As far as we know, since Mangasarian and Meyer [H] established existence results 
for this class of absolute value equations ([I]), the interest for this subject has increased substantially; 
see |111I131[20] and reference therein. 

Several algorithms have been designed to solve the systems of AVEs involving smooth, semi¬ 
smooth and Picard techniques; see [UITlIiniEIlES]. In [9], Mangasarian applied the nonsmooth 
Newton method for solving AVE obtaining global Q-linear convergence and showing its numerical 
effectiveness. However, each semi-smooth Newton iteration requires the exact solution of a linear 
system, which has an undesired effect on the computational performance of this method. The exact 
solution of the linear system, at each iteration of the method, can be computational expensive and 
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may not be justified. A well known alternative is to solve the linear systems involved approximately. 
A bound for the relative error tolerance to solve subproblem guaranteeing global Q-linear conver¬ 
gence will arise very clearly in the present work. Besides, the inexact analysis support the efficient 
computational implementations of the exact schemes, for this reason they are important and neces¬ 
saries. Following the ideas of [4] and [9], we use the inexact nonsmooth Newton method for solving 
absolute value equations and present some computational experiments designed to investigate its 
practical viability. 

The paper is organized as follows. The next subsection presents some notations and preliminaries 
that will be used throughout the paper. Section [2] devotes the definition of the inexact Newton 
method and its global Q-linear convergence. Section [3] provides an exhaustive discussion of the 
computational results of the inexact Newton method when it is compared with the exact one. We 
complete the paper with some conclusion for further study. 

1.1 Preliminaries 

In this section we present the notations and some auxiliary results used throughout the paper. 
Let M"" be denote the n-dimensional Euclidean space and || • || a norm. The i-th component of 
a vector x G is denoted by Xi for every i = l,...,n. For x € M”, sgn(x) denotes a vector 
with components equal to —1, 0 or 1 depending on whether the corresponding component of the 
vector X is negative, zero or positive. Denote |x| the vectors with Tth component equal to |x*|. 
The set of all n x n matrices with real entries is denoted by and M"" = The matrix Id 

denotes the n x n identity matrix. If x € then diag(x) will denote an n x n diagonal matrix 
with (i,i)-th entry equal to x®, i = l,...,n. For an M G consider the norm defined by 

||M|| ;= max{||Mx|| : x G ||x|| = 1}. This definition implies 

l|Mx|| < ||M||||x||, \\L + Mil < ||L|| + ||M||, ||LM|| < ||T||||M||, (2) 

for any matrices L,M ^ M®®^®® and x G M®®; see, for instance. Chapter 5 of [6]. The next useful 
result was proved in 2.1.1, page 32 of [El- 

Lemma 1 (Banach’s Lemma). Let E G M®®^®®. If ||F|| < 1, then the matrix Id —F is invertible and 
||[Id-F]-i||<l/(l-||F||). 

We end this section quoting the following result from combination of Lemma 2 of [9] and Propo¬ 
sition 3 of m, which gives us a sufficient condition for the invertibility of matrix A — D{x) for all 
X G M®® and existence of solution for AVE in ([!]) . 

Lemma 2. Assume that the singular values of the matrix A G M®®®^®® exceed 1. Then the matrix 
A — D{x) is invertible for all x G M®®. Moreover, AVE in ([T]) has unique solution for any b G M®®. 

The following proposition was proved in Proposition 4 of [El- 

Proposition 1. Assume that A G M®®^®® is invertible. If ||A“^|| < 1 then AVE in © has unique 
solution for any 6 G M®® . 


2 Inexact Semi-smooth Newton Method 

The exact semismooth Newton method [El for finding the zero of the semismooth function 

E{x) := Ax — \x\ — b, (3) 
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with starting point xq G K”', is formally defined by 

F(xk)+ Vk(xk+i - Xk) = 0, VkedF(xk), k = 0,l,..., 

where dF{x) denotes the Clarke generalized subdiferential of F at x € IBF; see [2j. Letting 

D{x) := diag(sgn(x)), x G M"', (4) 

we obtain from ([3l) that A — D{x) € dF{x). Hence, the exact semi-smooth Newton method for 
solving the AVE in ([T]), which was proposed by Mangasarian [9], generates a sequence formally 
stated as 

[A-D{xk)]xk+i = b. (5) 

To solve ([I]), following the ideas of [1], we propose an inexact semi-smooth Newton method, starting 
at xo € M"’ and residual relative error tolerance 6* > 0, by 

\\[A-D{xk)]xk+i-b\\ <9\\F{xk)\\, A: = 0,1,.... (6) 

Note that, in absence of errors, i.e., 9 = 0, the above iteration retrieves ([5]). In the next section we 
analyze the convergence properties of {x^} generated by the inexact semi-smooth Newton method. 

2.1 Convergence Analysis 

To establish convergence of the sequence {xfc}, generated by ([6]), we need some auxiliary results 
and basic definitions. 

The outcome of an inexact Newton iteration is any point satisfying some error tolerance. Hence, 
instead of a mapping for the inexact Newton iteration, we shall deal with a family of mappings 
describing all possible inexact iterates. 

Definition 1. For 9 > 0, Me is the family of maps Nq : M"’ M"’ such that 

\\[A-D{x)]Neix)-b\\<9\\F{x)\\, V x € M*". (7) 

If A — D{x) is invertible for all x G M"’, then the family Aq has a single element, namely, the 
exact Newton iteration map Nq : —>■ M"" defined by 

No{x) = [A-D{x)]-H. (8) 

Trivially, if 0 < 0 < 0' then A/q C J\fg C Afe'- Hence Afe is non-empty for all 0 > 0. 

Remark 1. Let x G M”" and A — D{x) be invertible. For any 0 < 9 < 1 and Nq G Afg, Nq{x) = x if 
and only if F{x) = 0. This means that the fixed points of the inexact Newton iteration map Ng are 
the same fixed points of the exact Newton iteration map. 

Lemma 3. Assume that A —D{x) is invertible for all x . Let 9 > 0 and Ng ^ Afg. //F(x*) = 0 
then for each x G M” there holds 

||A6)(x) - x*|| < ||[A - L)(x)]“^|| [9 (||A - D(x)|| + 2) + 2] ||x - x*||. 
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Proof. Let x G After simple algebraic manipulations and taking into account that F{x^) = 0 
and \A — -D(x)] x = Ax — |x|, we obtain 

Nq{x) — X* = [A — D{x)]~^ {[^~ ^i^)] ^e{x) — b + [F(x*) — F{x) — [A — D{x)] (x* — x)]). 

Taking norm in both side of above equality and using its properties in ([2]), we conclude that 

||iVe(x) - x*|| < ||[A - D(x)]"^|| (||[A - ^(x)] N^ix) - b\\ + ||-F(x*) - F{x) - [A- D{x)] (x* - x)||). 

The combination of Definition [T] and last inequality implies 

||Ai6i(x) - x*|| < ||[A - i:>(x)]“^|| {0 ||T(x)|| + ||T(x*) - F(x) - [A- D{x)] (x* - x)||). (9) 

On the other hand, since T(x*) = 0, direct algebraic manipulations give us 

F{x) = [A- D{x)] (x - X*) — [F(x*) - F(x) - [A - D{x)] (x* - x)] . 

Thus, taking norm in both sides of last equality and by triangular inequality, we have 

||-P(x)|| < ||A - -D(x)|| ||x - x*|| + ||T(x*) - F{x) - [A - D{x)] (x* - x)|| . (10) 

Now, using that D{x)x = |x|, D(x*)x* = |x*| and definition in ([3|), after some algebras, we can 
write 

F(x*) — F{x) — [A — D{x)] (x* — x) = —(|x*| — |x|) + L>(x)(x* — x). 

Since ||D(x)|| < 1, taking norms on both sides of last equality, and using the triangular inequality 
together with properties of the norm, namely, the first one stated in ([2|) yields 

||F(x*) — F{x) — [A — D{x)] (x* — x)|| < 2||x* — x||. (11) 

Therefore, combining the last inequality and (1101) . we conclude that 

||F(x)|| < ||A — D(x)|| ||x — x*|| + 2||x* — x||. 

Substituting the last inequality and (fTT]l into ([9]), we obtain 

||Ai6i(x) — x*|| < II [A — Zl(x)]“^|| [6<( \\A — D{x)\\ ||x — x*|| + 2||x — x*||) + 2||x — x*||], (12) 

which is equivalent to the desire inequality. □ 


Let 0 < 0 < 1 and Afo in Definition [T] Consider the sequence {x^} defined in ([6|). Thus, there 
exists Nq G Me such that 

Xk+i = Ne{xk), k = 0,l,---- (13) 

Now, we are ready to prove the two main results of this section. 


Theorem 1. Let A G b G R” and 0 < 6 < 1. Assume that A — D{x) is invertible for all 

X G R"’. Then, the inexact semi-smooth Newton sequence {x^}, given by ® , with any starting point 
xo G R” and residual relative error tolerance 9, is well defined. Moreover, if 


[A-D(x)]-' 



V X G R”, 


(14) 
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then, AVE in © has unique solution. Additionally, if 


0 < 6» < 


l-2\\[A-D{x)]-^\ 


V X € 


\\[A-D{x)]-m\\A-D{x)\\+2)^ 

then {xk} converges Q-linearly to x* € M"', a unique solution of ([I|), as follows 

||xfc+i - x*|| < ||[^ - -D(xfc)]“^|| [6 (||A - D{xk)\\ + 2) + 2] ||xfc - x* 
for all k = 0,1,.... 


(15) 


(16) 


Proof. For any starting point xq G M"’, by Definition [T] and ([6]), the well-definedness of {x^} follows 
from invertibility oi A — D{x) for all x G M”". The uniqueness of the solution follows from Propo¬ 
sition [H by taking x = 0 in dm). Since x* is the solution of ([I|) we have F(x*) = 0. Hence, using 
Lemma El and (fT^ . it is immediate to conclude that {x^} also satisfies (fT6]l . On the other hand, 
using (fTTl) and assumption on 6, i.e, the inequalities in (fT^ . we conclude that 

\\[A-D{xk)]-^\\[e{\\A-D{xk)\\+2) + 2] <1, k = 0,l,..., 

which, taking into account (fT6]l . implies that {x^} converges Q-linearly to x*. □ 

Remark 2. In the absence of errors, i.e., 6 = 0, Theorem[^ retrieves Lemma 6 of on the exact 
semi-smooth Newton method. Emphasizing that our assumption in (H is weaker than the used by 
Mangasarian in Lemma 6 of i.e., || [A — D{x)]~^ || < 1/3 for all x G M”". 

Theorem 2. Let A G be a invertible matrix, b G R”. Assume that 


u 


-ll 


3' 


(17) 


Then, the inexact semi-smooth Newton sequence {xk}, for solving ©, with any starting point 
Xq G R”' and residual relative error tolerance 9 >0, is well defined. Moreover, if 


o<e < 


1 - 3 U 


-i| 


l^-'ll(MII+3)’ 

then {xk} converges Q-linearly to x* G R"", the unique solution of ([I]), as follows 


(18) 


u 


-ll 


\\xk+i - a;*|| < ^ [9 (Pll -b 3) -b 2] \\xk - x*| 


k = 0,l,.... 


(19) 


Proof. Let x G R"’. Since ||H ^|| < 1/3, by ([2]), we have ||H ^L>(x)|| < 1/3 < 1. Thus, from 
Lemma [Hit follows that Id — A~^D{x) is invertible. Since A G is invertible and 


A-D{x) = A[ld-A-^D{x)] 


we conclude that A — D{x) is invertible. Hence {xk} is well defined, for any starting point xq G R"'. 

Since ||H“^|| < 1, the uniqueness follows from Proposition [TJ Let x* G R” be the unique solution 
of ([T|). Since A — D[x) is invertible for all x G R"', we may apply Lemma [3] to obtain 

\\Ne{xk) - x*|| < ||[^ - D{xk)]~^\\ [9 (||H - D{xk)\\ -b 2) -b 2] \\xk - x*||. A: = 0, 1 ,.... 
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On the other hand, it is easy to see that 

||[^ - D{xk)]~^\\ = ||[Id - A~^D{xk)]~^A~m < ||[Id - A~^D{xk)]~^\\ ||^"^|| , A: = 0, 1,. ... 
Thus, combining two last inequality we conclude that 

\\N 0 {xk) - x*|| < ||[Id - A~^D{xk)]~^\\ ||^“^|| [0{\\A - D{xk)\\ + 2) + 2] ||xfe-x*||, A; = 0,1,... . 

Hence, since ||j4“^T)(xfc)|| < ||^~^|| < 1/3, the inequality (|19ll follows from Lemma[T]and considering 
that 11^ — D{xk)\\ < ll^ll + 1. Finally, we conclude that {xk} converges Q-linearly to x*, by taking 
into account (HZl) and (HID. □ 

Remark 3. In the absence of errors, i.e., 0 = 0, Theorem\^ retrieves Proposition 7 of on the 
exact semi-smooth Newton method. Emphasizing that our assumption in (HID is weaker than the 
used by Mangasarian in Proposition 7 of J3i, i-e., ||^~^|| < 1/4. 

Note that the quantity in the right hand side in (|18p is less than l/cond(j4), where cond(A) = 
IIA||II||. Hence, for ill conditioned equations, 9 in (I18p has to be chosen small and hence the 
precision for solving Q may be high. It is worth to mention that, all ours results hold for any 
matrix norm satisfying ([2]). Observe that, the upper bound for 6 in (I18p . for the norms ||.||i and 
11.1 loo are easy to compute. 

In next result, we discuss a condition for identify a solution of the AVE throughout the sequence. 

Proposition 2. Assume that A — D{x) is invertible for all x € M"". If Xk+i = Xk for some k, then 
Xk is solution of ©■ 

Proof. Since Xk+i = Xk, it follows from (fT^ that Xk = Thus, from Remark [T] we conclude 

that F{xk) = 0, which implies that Xk is solution of ([T|). □ 

If 0 = 0 then D{xk) = D{xk+i) is a sufficient condition for x^+i be solution of ©; see [9]. 
However, this does not occur in the inexact semi-smooth Newton method defined by ([6|), as observed 
in the next example. 

Example 1. Setting the data of problem ([3|) as A = Aid and b = e, where e is the ones vector in 
we obtain F{x) = Ax — |x| — e. Note that x* = (1/3) e is the unique solution of problem ([I]) and 
||[A — T)(x)]“^|| < 1/2 for all x € and ||A“^|| = 1/4 < 1/3 within the below assumptions (fTTll in 
Theorem [I] and (ini) in Theorem (H respectively. Starting at xq = e, the iteration ([6]) leads us 

\\[A - D{xo)]xi - b\\ = ||3xi - e|| < 0 ||3xo - e|| = ||20e||, 

for all 0 < 6 < 1. Thus, we can take xi = [(20 -|- l)/3]e, implying D{xq) = D{xi) = Id and 

F{xi) = [A — D{xi)] xi — b = 3xi — e = 20e / 0. 

Therefore, xi is not solution. 

The invertibility of A — D{x), for all x G M”', is sufficient to the well-definition of the exact and 
inexact Newton’s method. However, the next example shows that, for the convergence of these 
methods, an additional condition on A must be assumed, for instance, (flip and (fTTll . 
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Example 2. Consider the function E : —)• defined by F(x) = Ax — \x\ — b, where 


A = 


1 

3 




Note that ||^~^|| = 1,7071... and the matrices A — D{x) are invertible, for all x G M^. Moreover, F 
has X* = —e as the unique zero, where e is the ones vector in Applying exact Newton’s method 
starting with xq = e, for finding the zero of F, the generated sequence oscillates between the points 


xi 


r 

3 

1 ’ 


X2 = 


1 

3 


3 Computational Results 

In order to verify the effectiveness of our approach, we compared the performance of the exact 
and inexact semi-smooth Newton methods for solving several AVEs. In a first group of tests, A is 
supposed to be a large-scale sparse matrix. The influence of the condition number and density of 
A were also investigated. In many considered cases the performance of the inexact semi-smooth 
Newton methods is remarkably better than that of the exact one. All codes were implemented in 
Matlab 7.11.0.584 (R2010b) and are free available in https://orizon.mat.ufg.br/admin/pages/11432- 
codes. The experiments were run on a 3.4 GHz Intel(R) i7 with 4 processors, 8Gb of RAM and 
Linux operating system. Following, we enlighten some implementation details. 

(i) Convergence criteria: The implemented methods stop at iterate Xk reporting “Solution found” 
if AVE is solved with accuracy 10“®. This means that the 2-norm of Ax^ — \xk\ — 6 is less than or 
equal to 10“®. In some cases we use a different tolerance that will be opportunely reported. The 
methods also stop reporting failure if the number of iterations exceeds 50. 

(ii) Cenerating random problems: To construct matrix A we used the Matlab routine sprand, which 
generates a sparse matrix with predefined dimension, density and singular values. Firstly, we defined 
the dimension n and random generated the vector of singular values rc from a uniform distribution 
on (0 1). To ensure fulfillment of the hypothesis of Theorem [2l we rescale rc by multiplying it by 
3 divided by the minimum singular value multiplied by a random number in the interval (0 1). 
Finally, we evoke sprand. In this case, A is generated by random plane rotations applied to a 
diagonal matrix with the given singular values rc. After that, we chose a random solution x and 
initial point xq from a uniform distribution on (—100 100) and computed b = Ax — |x|. Note that, 
since the singular values of A are known, the calculation of the residual relative error tolerance 9 is 
simple. In particular, we defined 0 as the right hand side of (|18jl multiplied by 0.9999. 

(iii) Solving linear equations: In each iteration of the exact semi-smooth Newton method, the linear 
system ([5]) must be exactly solved. In this case, we used the mldivide (same as backslash) command 
of Matlab. In order to take advantages of the structure of the problem, mldivide performs a study of 
the matrix of the linear system. The first distinction the function makes is between dense and sparse 
input arrays (sparsity must be informed by the user). Since the random matrix A has no special 
structure, mldivide should compute the bandwidth of A and use a banded solver in the case of A is 
sparse (band density less than or equal to 0.5), or use LU solver, otherwise. LU factorization can be 
used for both (informed) sparse and dense matrices. On the order hand, the inexact semi-smooth 
Newton iteration requires to approximately solve the linear system ([5|) in the sense of ([6|). Matlab 
has several iterative methods for linear equations. In order to choose the most appropriate one. 
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we performed a preliminary test comparing the performance of all of them. We run the inexact 
semi-smooth Newton method with each iterative methods for 50 problems with n = 400 and density 
equal to 0.01. The method with the routine Isqr was the most efficient in all considered problems. 
Therefore, in all forthcoming tests, we used Isqr as iterative method to approximately solve linear 
equations. The routine Isqr is an algorithm for sparse linear equations and sparse least squares 
based on [16]. We highlight that Xk is used as a starting point by Isqr to solve the linear system 
ol k + \ iteration. In the numerical tests of Section [Q where the density of A is approximately 
equal to 0.003, the matrices of linear systems were reported to be sparse for both exact and inexact 
semi-smooth Newton methods. In Section [3.21 where we analyzed the influence of higher densities, 
linear systems were solved considering full matrices for both methods. 

We presented the numerical comparisons using performance profiles graphics; see |5|. Defined 
a performance measurement (for example, CPU time), performance profiles are very useful tools 
to compare several methods on a large set of test problems. In a simple manner, they allow us 
to compare efficiency and robustness. The efficiency of a method is related to the percentage of 
problems for which the method was the fastest one, while robustness is related to the percentage of 
problems for which the method found a solution. In a performance profile, efficiency and robustness 
can be accessed on the extreme left (at I in domain) and right of the graphic, respectively. In all 
group of tests, we use CPU time as performance measurement. In order to obtain more accurately 
the CPU time, we run all test problems in each method ten times and we defined the corresponding 
CPU time as the median of these measurements. For each problem, we consider that a method is 
the most efficient if its runtime does not exceed in 5% the CPU time of the fastest one. 

3.1 Large-Scale Sparse AVEs 

It is well-known that direct methods to solve linear systems can be impractical if the associated 
matrix is large and sparse. Basically, there are two reasons. First, the factorization of the matrix 
can cause fill-in, losing the sparsity structure and generating additional computational cost. Second, 
a floating-point error made in one step spreads further in all following ones. Therefore, it is rarely 
true in applications that direct methods give the exact solution of linear systems and, in some 
cases, they are not able to find the solution with a desired accuracy. In the forthcoming numerical 
results, this phenomenon will appear very clearly. It is opportune to mention that there are many 
direct methods for large-scale sparse linear systems that seek to alleviate these drawbacks; see, for 
example, [3]. On the other hand, iterative methods do not exhibit these disadvantages because they 
do not work with matrix factorization and they are self-correcting, in the sense that, if floating-point 
errors affect Xk during the /c-th iteration, Xk can be considered as a new starting point, not affecting 
the convergence of the method. Consequently, iterative methods are, in general, more robust than 
the direct ones. 

Seeking to solve an AVE, the exact and inexact Newton iterates deal with a large-scale sparse 
linear system when matrix A has these characteristics. The previous discussion allows us to con¬ 
jecture that, in this case, the inexact Newton method is better than the exact one. In an attempt 
to confirm this intuition, in the first group of tests, we generated 200 AVEs with n = 10000 and 
density of A approximately equal to 0.003. This means that, only about 0.3% of the elements of 
A are non null. In this set of problems, the average condition number of A is approximately 40 
(lowest and largest values is 1.87 and 1610, respectively), while the average 9 is of order of 10“^. 
Figure [T] shows a comparison, using performance profiles, between exact and inexact semi-smooth 
Newton methods in this set of test problems. 
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Figure 1: Performance profile comparing Inexact versus Exact semi-smooth Newton method for 
large-scale sparse AVEs with well conditioned matrices. 


Analyzing Figure [H we see that, as expected, the inexact method is more efficient than the exact 
one. However, it may be surprising that the difference is so stark. Efficiencies of the methods are 
97,5% and 5%, respectively, for the inexact and exact versions. The robustness is 98% for both 
ones. The methods failed to solve the same four problems. Nevertheless, it is interesting to point 
out that, for this four problems, both methods reached a very close accuracy from the required one 
to report “Solution found”. In this first set of problems, the exact Newton method was faster in 
just one problem (21.4s against 35.6s of the inexact method). Curiously, this is the problem for 
which the condition number of A is the highest value among all considered ones. Considering only 
the others solved problems, the methods spent in total 201s and 4541s for the inexact and exact 
versions, respectively. The inexact method solves a typical problem of this set in less than a second 
while the exact one takes about 20s (in average, the exact method demands 57 times the runtime 
of the inexact one). The average number of iterations was, respectively, 9.6 and 3.4, showing that, 
as expected, the exact iteration requests greater computational effort than the inexact one. 

Since average condition number of the matrices of the first set problems are relatively small 
(consequently, in average, the matrices are well conditioned), we investigated the performance of 
the methods in sets of ill-conditioned matrices. This analysis is pertinent because, as observed, the 
right hand side of (IlSp is less than the inverse of condition number. So, for ill-conditioned matrices, 
the iterative solver for linear equations needs to be much required. It is not reasonable to set a 
value for the condition number to claim a matrix as “ill-conditioned”. Therefore, in this second 
phase, we generated two sets of 200 AVEs. In the first one, the condition numbers of all matrices 
A are greater than or equal to 10^ (the average is 4.73 x 10^) while, in the second one, are greater 
than or equal 10® (the average is 1.72 x 10®). We emphasize that in these second phase, we keep 
n = 10000 and the density of A approximately equal to 0.3%. Figure [2] shows a comparison between 
exact and inexact semi-smooth Newton methods in this two sets of test problems. 

In the first set of the second phase, analyzing Figure[2Ka), we see that the inexact Newton method 
is more efficient than the exact one (efficiencies are 79% and 9%, respectively), while robustness rates 
are 84% and 88%, respectively. The robustness difference corresponds to 8 problems that were solved 
by exact method and failed to be solved by the inexact one. Reciprocally, there is no problem. In 
others 24 problems, both methods failed. However, in all cases of failure, regardless of the method, 
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Figure 2; Performance profile comparing Inexact versus Exact semi-smooth Newton method for 
large-scale sparse AVEs with “ill-conditioned” matrices: (a) cond(A) ~ 10^ and (b) cond(A) ~ 10^. 

the achieved accuracy was close to the desired one (typically, order of 10“®). This allows us to 
conclude that both methods were equivalently robust. In terms of processing time, comparing with 
the set of problems of the first phase, the exact Newton method showed a considerable improvement. 
Note by Figure [2](a) that the performance functions intersect each other approximately at 7 in the 
domain, while in Figure [T] the intersection takes place approximately at 160. Consequently, the 
difference between the two methods is much smaller in the case that the condition number of A is 
order of 10^ than in the case where it is order of 10^. 

Consider now the second set of problems where the condition numbers of A are of order of 10^. 
Both methods were not able to solve with accuracy 10“® an AVE that belongs to this set of ill- 
conditioned problems. So, in this specific case, we used the accuracy equal to 10“®. For the inexact 
method, the average value of 9 is 2.85 x 10“®. Figure [2](b) shows the performance of the methods. 
As we can note, the exact Newton method achieved much higher performance compared with the 
inexact one. The exact method was the faster one in all problems that were solved by both methods. 
The robustness is 59% and 97% for the inexact and exact method, respectively. The high efficiency 
of the exact Newton method is connected with the ability of this method to solve a problem with 
a moderate accuracy (10“^) in a few iterations. The exact method did not need more than three 
iterations in order to solve a problem of this set: 166 problems were solved with 2 iterations, while 
28 with 3 iterations. On the other hand, since 9 is oder of 10“®, the iterative linear equations solver 
is much required in an early iteration of the inexact method, generating additional runtime. The 
poor robustness of the inexact method can be related with the lack of robustness of the Isqr routine 
to deal with ill-conditioned matrices. It is appropriate to mention that no preconditioner was used 
in Isqr. 

Table [T] summarizes the results of the numerical experiments of the current section. The column 
“cond(A)” informs the (average) order of the condition number of the matrices A, while column 
“to/” reports the considered accuracy to solve an AVE. 
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Inexact Newton method 

Exact Newton method 

cond(A) 

tol 

Efficiency (%) 

Robustness (%) 

Efficiency (%) 

Robustness (%) 

10" 

10““ 

97.5 

98.0 

5.0 

98.0 

10^ 

10“® 

79.0 

84.0 

9.0 

88.0 

10® 

10“® 

0.0 

59.0 

97.0 

97.0 


Table 1: Efficiency and robustness rates of the Inexact and Exact Newton methods for three sets 
of large-scale sparse AVEs varying the condition number of the matrices. 


The numerical experiments of this section allow us to conclude that the inexact Newton method 
is much more efficient than the exact one when A is a large-scale sparse matrix with a “moderate” 
condition number. Eor matrices with higher condition numbers (order of 10®), both methods failed 
to solve the AVE problem with accuracy 10“®. Considering a greater tolerance (10“®), the exact 
method was the most efficient and robust. This indicates that, at least in our implementation, the 
inexact Newton method is more sensitive to the increase of the condition number than the exact 
one. 


3.2 Influence of Density 

The iterative linear equations solvers are suitable for large and sparse matrices, particularly for the 
routine Isqr. Therefore, in this section, we investigated the influence of the density of matrix A on the 
performance of the exact and inexact semi-smooth Newton methods. In this third phase, we decided 
to deal only with relatively “well-conditioned” matrices because, according to the experiments of the 
previous section, both methods presented greater robustness on this class of problems. Theoretically, 
it is expected that the huge efficiency difference presented in Figure [U be reduced. 

We generated four sets of 200 AVEs varying the density of matrix A. The density of the matrices 
in each set is approximately equal to; (a) 10%, (b) 40%, (c) 80% and (d) 100%. The Matlab routine 
sprand is efficient to generate sparse matrices. When the input density is high, sprand requires 
much processing time. In order to alleviate this cost, we decided to decrease the dimension of the 
matrices. In each set of AVEs we adopted n equal to 3000 for the first two sets and 1500 for the 
other two. The average condition number of the matrices in each set is approximately equal to 
11, 35, 17 and 18, respectively. Figure [3] shows the performance profiles, while Table [2] shows the 
efficiency and robustness rates of the Inexact and Exact Newton methods in this four sets of test 
problems. 



Inexact Newton method 

Exact Newton method 

n 

density (%) 

Efficiency (%) 

Robustness (%) 

Efficiency (%) 

Robustness (%) 

3000 

10 

70.5 

99.5 

34.5 

98.0 

3000 

40 

73.5 

99.0 

30.0 

87.0 

1500 

80 

50.5 

99.5 

53.5 

88.5 

1500 

100 

55.0 

99.0 

46.0 

79.5 


Table 2: Efficiency and robustness rates of the Inexact and Exact Newton methods for four sets of 
AVEs varying the density of the matrices. 


Analyzing Figure [3] and Table [2 we see that, as expected, the difference between the methods 
was decreased compared to the case where problems are sparse, see Figure [2 For a moderate 
density (10% and 40%), the inexact Newton method is more efficient than the exact one (efficiency 
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Figure 3: Performance profile comparing Inexact versus Exact semi-smooth Newton method for 
dense AVEs with well-conditioned matrices. Density of A is approximately equal to: (a) 10%, 
(b) 40%, (c) 80% and (d) 100%. 
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rate is 70.5% and 73.5% against 34.5% and 30.0%, respectively). Considering full matrices (density 
80% and 100%) both methods showed equivalent efficiency rates: 50.5% and 55.0% for the inexact 
method against 53.5% and 46.0% for the exact one, respectively. Independently of density, the 
robustness rate of the inexact Newton method is greater than or equal to 99.0%. On the other 
hand, as we can see in Table O the robustness rate of the exact method decreases according to 
the increase of the density. This phenomenon is clearly connected with the fact that the greater 
the density, the more operations are required by the direct method to to solve a linear equation. 
Consequently, the exact Newton method is most affected by the accumulation of floating-point 
errors resulting in lower robustness. Obviously, the number of operations to solve a linear equation 
also depends on the dimension n. So, considering the exact Newton method, the robustness rate of 
87.0%, in the set of problems where n = 3000 and the density is approximately 40%, is consistent 
with robustness rate of 88.5% where the dimension and density are 1500 and approximately 80%, 
respectively. 

The numerical experiments of this section allow us to conclude that, at least in problems where 
% is a “well-conditioned” matrix, the inexact Newton method proved to be competitive (in terms 
of efficiency) with the exact method even if % is a full matrix. Considering robustness, while the 
inexact Newton method did not lose performance, the exact method was found to be sensitive with 
density increase. 


4 Final Remarks 

In this work we dealt with the global Q-linear convergence of the inexact semi-smooth Newton 
method for solving AVE in ([1]). In particular, a bound for the relative error tolerance to solve 
subproblem arises very clearly in the presented results. The inexact analysis support the efficient 
computational implementations of the exact schemes. Our implementation shows the advantage 
over the exact method in many considered cases, for instance, sparse and large scale problems. 
We hope that this study serves as a basis for future research on other more efficient variants for 
solving AVE. We intend to study the semi-smooth Newton method from the point of view of actual 
implementations and provide comparisons with alternative approaches. Additional numerical tests 
indicate that our sufficient condition for convergence can be relaxed, which also deserver to be 
investigate. 
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